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DETAILED ACTION 
Response to Amendment 

The amendment, filed 4/14/2010, has been entered and made of record. Claims 24- 
26,29,31-39 and 42-48. 

Response to Arguments 
Applicant's arguments with respect to the independent claims and the Chen and Foran et 
al. references have been considered but are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC § 103 
This application currently names joint inventors. In considering patentability of the 
claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of the various 

claims was commonly owned at the time any inventions covered therein were made absent any 
evidence to the contrary. Applicant is advised of the obligation under 37 CFR 1.56 to point out 
the inventor and invention dates of each claim that was not commonly owned at the time a later 
invention was made in order for the examiner to consider the applicability of 35 U.S.C. 103(c) 
and potential 35 U.S.C. 102(e), (f) or (g) prior art under 35 U.S.C. 103(a). 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 
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1 . Claims 24-26,28,33-37,39,43 and 45-48 rejected under 35 U.S.C. 103(a) as being 
unpatentable over Chen et al. (US 2005/0075537) in view of Foran et al. (US # 7,027,633) and 
further in view of Adier et al. (US 2002/0177779). 

As to claim 24, Chen et al. teaches a method for displaying frames from an in vivo image 
stream (Figure 4, CRT display "404"), said method comprising: assigning two or more scores to 
each of a plurality of frames based on a degree of variation ([0036]; {The examiner interprets a 
score as a match and the two or more scores as the matches occurring for the more than one 
features in the image (i.e. for color, texture or shape).}) of a predetermined criterion ([0036], 
Lines 1-3, " . . .Image features such as color , texture ...") of each frame ([0036], Lines 3-5, 
". . .segmented regions of the GI tract image. . .") and a predetermined criterion of a reference 
frame (Figure 4, predetermined templates "534"; [0036], Lines 7-9). Chen et al. does not detail 
how the in vivo GI tract images are displayed. In this regard, Chen et al. fails to disclose the step 
of displaying at least a subset of the plurality of frames from the in vivo stream substantially 
simultaneously, wherein the subset of frames are positioned spatially in order of ascending or 
descending degree of variation based on the scores assigned thereto (1). The claim fiirther differs 
from Chen et al. in that it requires that the two or more reference frames are used to assign two 
or more scores (2). 

In the same field of endeavor, Foran et al. teaches a collaborative diagnostic system 
including tools for computer-assisted evaluation of objective characteristics of pathologies 
(Figures 4 and 5). The system includes a computer workstation including a user interface (Figure 
6, user interface "600") which displays substantially simultaneously matched images (Figure 6, 
matched images "608") along with metadata (Figure 6, "Retrieval 1 . . .", "Retrieval 2. . .", etc.) in 
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order of similarity (Col. 18, Lines 4-9) to a reference frame (Figure 6, image "602") (1). In light 
of the teaching of Foran et al., it would have been obvious to one of ordinary skill in the art to 
include the ability to display the images matching the predetermined templates along with the 
metadata of Chen et al. in the manner of Foran et al., because this would allow for improved 
diagnostic accuracy and early detection for pathologies (see Foran et al., Col. 2, Lines 20-23). 

Further in the same field of endeavor, Adler et al. teaches a system for detecting 
colorimetric abnormalities from an in vivo image sfream. The system acquires a plurality of 
images from an in vivo image source. These images are compared against a plurality of 
references frames which are averaged in order to obtain a reference sample of healthy tissue. 
Based on the results of comparison, an abnormality can be identified and studied (2) (Figure 4; 
[0025]-[0037]). In light of the teaching of Adler et al., it would have been obvious to one of 
ordinary skill in the art to compare the images of Chen et al. to the plurality of averaged frames, 
because an artisan of ordinary skill in the art would recognize that this would prevent erroneous 
comparison due to changing parameters of healthy tissue along the GI tract (see Adler et al, 
[0027], Lines 7 and 8). 

As to claim 25, Chen et al., as modified by Foran et al. and Adler et al., teaches the 
method according to claim 24 comprising displaying the in vivo image sfream as a multi-frame 
image stream (see Chen et al, Figure 4; see Foran et al., Figure 6). 

As to claim 26, Chen et al., as modified by Foran et al. and Adler et al., teaches the 
method according to claim 24 comprising adjusting a rate at which the multi-frame image sfream 
is displayed based on the content of the frames (see Chen et al., [0046]; {The image stream is 
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adjusted by thresholding the color feature matching. Without the color feature detection, all 
images of the in vivo stream will be displayed.}). 

As to claim 28, Chen et al., as modified by Foran et al. and Adler et al., teaches the 
method according to claim 24 wherein the scores are assigned based on a degree of color 
variation of the displayed frames as compared to the reference frames (see Chen et al., [0036] 
and Adler et al, [0027], Lines 1-5, "...color components..."). 

As to claim 33, Chen et al., as modified by Foran et al. and Adler et al., teaches the 
method according to claim 24 comprising displaying sensor data from a sensor other than an 
image sensor substantially simultaneously as the frames from the in vivo image stream (see Chen 
et al, Figure 2A; [0030]). 

As to claim 34, Chen et al. teaches a system for displaying frames of an in vivo image 
stream (Figure 4, CRT display "404"), the system comprising: an in vivo imaging device (Figure 
1, capsule "1 12"; [0034], Lines 4-7) to transmit an in vivo image stream (Figure 1, image 
transmitter "106"); a processor (Figure 4, examination bundlette processor "402") to assign two 
or more scores to each of a pliu-ality of frames based on a degree of variation ([0036]; {The 
examiner interprets a score as a match and the two or more scores as the matches occurring for 
the more than one features in the image (i.e. for color, texture or shape).}) between a 
predetermined criterion ([0036], Lines 1-3, "...Image features such as color , texture ...") of each 
frame ([0036], Lines 3-5, ". . .segmented regions of the GI tract image. . .") and a predetermined 
criterion of a reference frame (Figure 4, predetermined templates "534"; [0036], Lines 7-9). 
Chen et al. does not detail how the in vivo GI tract images are displayed. In this regard, Chen et 
al. fails to disclose a display to display a multi-frame image stream, wherein each multi-frame 
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image thereof displays at least a subset of the plurality of frames substantially simultaneously, 
wherein the subset of frames are positioned spatially in order of ascending or descending degree 
of variation based on the scores assigned thereto (1). The claim fiirther differs from Chen et al. in 
that it requires that the two or more reference frames are used to assign two or more scores (2). 

In the same field of endeavor, Foran et al. teaches a collaborative diagnostic system 
including tools for computer-assisted evaluation of objective characteristics of pathologies 
(Figures 4 and 5). The system includes a computer workstation including a user interface (Figure 
6, user interface "600") which displays substantially simultaneously matched images (Figure 6, 
matched images "608") along with metadata (Figure 6, "Retrieval 1 . . .", "Retrieval 2. . .", etc.) in 
order of similarity (Col. 18, Lines 4-9) to a reference frame (Figure 6, image "602") (1). In light 
of the teaching of Foran et al., it would have been obvious to one of ordinary skill in the art to 
include the ability to display the images matching the predetermined templates along with the 
metadata of Chen et al. in the manner of Foran et al., because this would allow for improved 
diagnostic accuracy and early detection for pathologies (see Foran et al., Col. 2, Lines 20-23). 

Further in the same field of endeavor, Adler et al. teaches a system for detecting 
colorimetric abnormalities from an in vivo image sfream. The system acquires a plurality of 
images from an in vivo image source. These images are compared against a plurality of 
references frames which are averaged in order to obtain a reference sample of healthy tissue. 
Based on the results of comparison, an abnormality can be identified and studied (2) (Figure 4; 
[0025]-[0037]). In light of the teaching of Adler et al., it would have been obvious to one of 
ordinary skill in the art to compare the images of Chen et al. to the plurality of averaged frames, 
because an artisan of ordinary skill in the art would recognize that this would prevent erroneous 
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comparison due to changing parameters of healthy tissue along the GI tract (see Adler et al., 
[0027], Lines 7 and 8). 

As to claim 35, Chen et al., as modified by Foran et al. and Adler et al., teaches the 
system of claim 34 wherein the in vivo imaging device is an autonomous capsule (see Chen et 
al, Figure 1, capsule "112"; [0034], Lines 4-7, "...swallowed capsule..."). 

As to claim 36, Chen et al., as modified by Foran et al. and Adler et al, teaches the 
system of claim 34 comprising a pH sensor (see Chen et al., [0030], Lines 9-15, ". . .non-image 
sensed characteristics such as pH. . ."). 

As to claim 37, Chen et al., as modified by Foran et al. and Adler et al., teaches the 
system of claim 34 wherein the scores are assigned based on data detected by a sensor (see Chen 
et al.. Figure 1, camera "104"; {The match is determined by the image features which are 
captured by the camera.}). 

As to claim 39, Chen et al. teaches a method for displaying frames from an in vivo image 
stream (Figure 4, CRT display "404"), the method comprising: selecting a plurality of fi-ames 
from an in vivo image stream (Figure 3, IN VIVO RF TRANSMITTER "306"; {The examiner 
interprets the images that are transmitted as selected.}); assigning two or more scores to each of 
a plurality of frames based on a degree of variation ([0036]; {The examiner interprets a score as 
a match and the two or more scores as the matches occurring for the more than one features in 
the image (i.e. for color, texture or shape).}) between a predetermined criterion ([0036], Lines 1- 
3, ".. .Image features such as color, texture ...") of each frame ([0036], Lines 3-5, ". . .segmented 
regions of the GI tract image. . .") and a predetermined criterion of a reference frame (Figure 4, 
predetermined templates "534"; [0036], Lines 7-9). Chen et al. does not detail how the in vivo 
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GI tract images are displayed. In this regard, Chen et al. fails to disclose the step of displaying at 
least a subset of the plurality of frames from the in vivo stream substantially simultaneously, 
wherein the subset of frames are positioned spatially in order of ascending or descending degree 
of variation based on the scores assigned thereto (1). The claim fiirther differs from Chen et al. in 
that it requires that the two or more reference frames are used to assign two or more scores (2). 

In the same field of endeavor, Foran et al. teaches a collaborative diagnostic system 
including tools for computer-assisted evaluation of objective characteristics of pathologies 
(Figures 4 and 5). The system includes a computer workstation including a user interface (Figure 
6, user interface "600") which displays substantially simultaneously matched images (Figure 6, 
matched images "608") along with metadata (Figure 6, "Retrieval 1...", "Retrieval 2...", etc.) in 
order of similarity (Col. 18, Lines 4-9) to a reference frame (Figure 6, image "602") (1). In light 
of the teaching of Foran et al., it would have been obvious to one of ordinary skill in the art to 
include the ability to display the images matching the predetermined templates along with the 
metadata of Chen et al. in the manner of Foran et al., because this would allow for improved 
diagnostic accuracy and early detection for pathologies (see Foran et al.. Col. 2, Lines 20-23). 

Further in the same field of endeavor, Adler et al. teaches a system for detecting 
colorimetric abnormalities from an in vivo image sfream. The system acquires a plurality of 
images from an in vivo image source. These images are compared against a plurality of 
references frames which are averaged in order to obtain a reference sample of healthy tissue. 
Based on the results of comparison, an abnormality can be identified and studied (2) (Figure 4; 
[0025]-[0037]). In light of the teaching of Adler et al., it would have been obvious to one of 
ordinary skill in the art to compare the images of Chen et al. to the plurality of averaged frames. 
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because an artisan of ordinary skill in the art would recognize that this would prevent erroneous 
comparison due to changing parameters of healthy tissue along the GI tract (see Adier et al, 
[0027], Lines 7 and 8). 

As to claim 43, Chen et al., as modified by Foran et al. and Adler et al., teaches the 
method according to claim 39 wherein the scores are assigned based on color variation of the 
plurality of frames as compared to the reference frames (see Chen et al, [0036] and Adler et al, 
[0027], Lines 1-5, "...color components..."). 

As to claim 45, Chen et al., as modified by Foran et al. and Adler et al., teaches the 
method according to claim 24 wherein the reference frames represents a pathology (see Chen et 
al, [0036], Lines 7-9, ". . .statistical representations of GI tract abnormalities . . .") and wherein 
frames having a low degree of variation with respect to the pathology reference frame (see Chen 
et al., [0036], Lines 9-13, matches have low degrees of variation) are displayed (see Foran et al.. 
Figure 6, matched images "608"). 

As to claim 46, Chen et al., as modified by Foran et al. and Adler et al., teaches the 
method according to claim 24 comprising selecting or generating the reference frames (see Chen 
et al.. Figure 6, predetermined templates are generated somehow). 

As to claim 47, Chen et al, as modified by Foran et al. and Adler et al., teaches the 
method according to claim 46 wherein selecting or generating the reference frames is based on 
the frames to be displayed (see Chen et al., [0036]; {The system generates the predetermined 
templates of the GI tract due to the fact that the displayed frames are taken in the GI tract.}). 

As to claim 48, Chen et al., as modified by Foran et al. and Adler et al., teaches the 
method according to claim 24 wherein the predetermined criterion is selected from the group 
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consisting of: color (see Chen et al., [0036], Lines 1-3, ". . .Image features such as color ..."), 
shape features, focusing, lighting, blood detection, and image content which may not be 
associated with a pathology. 

2. Claim 3 1 and 42 are rejected under 35 U.S.C. 103(a) as being unpatentable over Chen et 
al. (US 2005/0075537) in view of Foran et al. (US # 7,027,633) in view of Adler et al. (US 
2002/0177779) and fiirther in view of Balabanovic et al. (US # 6,976,229). 

As to claim 31, Chen et al., as modified by Foran et al. and Adler et al., teaches the 
method according to claim 24. The claim differs from Chen et al., as modified by Foran et al. and 
Adler et al., in that it fiirther requires the step of adjusting the size of at least one of the frames 
displayed based on the assigned scores. 

In the same field of endeavor, Balabanovic et al. teaches a method of displaying image 
frames wherein a user can select an image frame from a plurality of grouped images in order to 
enlarge the frame for viewing (Figure 1 , large image "120" and thumbnail images of tracks 
"105", "1 10" and "115"). In light of the teaching of Balabanovic et al., it would have been 
obvious to one of ordinary skill in the art to include the ability to enlarge a displayed image in 
the system of Foran et al, because an artisan of ordinary skill in the art would recognize that this 
would allow a physician to get a better view of a potentially abnormal frame of the GI tract. 

As to claim 42, Chen et al., as modified by Foran et al. and Balabanovic et al., teaches the 
method according to claim 39 wherein at least two of the plurality of frames are displayed having 
different sizes (Figure 1, large image "120" and thumbnail images of tracks "105", "1 10" and 
"115"). 
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3. Claim 32 is rejected under 35 U.S.C. 103(a) as being unpatentable over Chen et al. (US 
2005/0075537) in view of Foran et al. (US # 7,027,633) in view of Adler et al. (US 
2002/0177779) and further in view of Shibanuma (US # 5,642,157). 

As to claim 32, Chen et al., as modified by Foran et al. and Adler et al, teaches the 
method according to claim 24. The claim differs from Chen et al., as modified by Foran et al. and 
Adler et al., in that it fiirther requires that the in vivo image stream includes fi-ames captured 
fi-om more than one image sensor. 

In the same field of endeavor, Shibanuma teaches a system including an endoscope 
apparatus used in combination with another medical diagnostic imaging device in which video 
signals fi-om both devices can be displayed simultaneously or can be switched between on a 
display device (Figures 5A and 5B; Col. 2, Lines 44-52). In light of the teaching of Shibanuma, 
it would have been obvious to one of ordinary skill in the art to include the ability to display 
multiple fi"ames fi-om multiple sensors in the system of Chen et al., as modified by Foran et al. 
and Adler et al., because this would allow for an improved image display technique (see 
Shibanuma, Col. 1, Lines 7-11) 

4. Claim 38 is rejected under 35 U.S.C. 103(a) as being unpatentable over Chen et al. (US 
2005/0075537) in view of Foran et al. (US # 7,027,633) in view of Adler et al. (US 
2002/0177779) and fiirther in view of Iddan et al. (US # 6,764,440). 

As to claim 38, Chen et al., as modified by Foran et al. and Adler et al., teaches the 
system of claim 34. The claim differs fi-om Chen et al., as modified by Foran et al. and Adler et 
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al, in that it further requires that the processor is to adjust the stream rate of the multi- frame 
image stream. 

In the same field of endeavor, Iddan et al. teaches a method for energy management of a 
video capsule wherein in order to save power; and consequently, reduce a stream rate of captured 
images, a control unit discontinues the power supply of the capsule in order to prevent the 
capture of redundant images according to the axial movement of the capsule (Figures 1 and 2; 
Col. 3, Lines 7-17). In light of the teaching of Iddan et al., it would have been obvious to one of 
ordinary skill in the art to include this energy management method in the system of Chen et al., 
because an artisan of ordinary skill in the art would recognize that this would save power and, by 
reducing the capture of redundant images, allow for better diagnostics as redundant images may 
lead a physician to confiision. 

5. Claim 44 is rejected under 35 U.S.C. 103(a) as being unpatentable over Chen et al. (US 
2005/0075537) in view of Foran et al. (US # 7,027,633) in view of Adler et al. (US 
2002/0177779) and further in view of BiUe (US 2005/01 10948). 

As to claim 44, Chen et al., as modified by Foran et al. and Adler et al., teaches the 
method according to claim 24. The claim differs from Chen et al., as modified by Foran et al. and 
Adler et al, in that it further requires that the reference frames represent healthy tissue and 
wherein frames having a high degree of variation with respect to the healthy tissue reference 
frame are displayed to represent pathologies. 

In the same field of endeavor, Bille teaches an imaging system for diagnostically 
evaluating the health of tissue, wherein an in vivo image of tissue is acquired and compared to a 
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template representing healthy tissue (Figure 1; Col. 6, Lines 27-35). In light of the teaching of 
Chen et al., as modified by Foran et al., it would have been obvious to one of ordinary skill in the 
art to use healthy normal GI tract images as templates when performing feature matching in the 
system of Chen et al., because as a supplement, this would provide allow higher quality 
abnormality detection and by itself, may be more appropriate for abnormality detection in 
different lighting situations. 



Conclusion 

Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to ANTHONY J. DANIELS whose telephone number is (571)272- 
7362. The examiner can normally be reached on 8:00 A.M. - 5:30 P.M.. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Sinh Tran can be reached on (571) 272-7564. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an apphcation may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Sinh Tran/ 

Supervisory Patent Examiner, Art Unit 
2622 

AD 

7/2/2010 



